Web Survey Bibliography
Survey respondents misunderstand questions more frequently than one might expect but, current methods for collecting data make it hard to detect and correct misunderstanding. The conventional practice has been to leave the interpretation of questions up to respondents; interviewers react to requests for clarification with nondirective probes like "Let me repeat the question." The current article reviews a research program that has explored alternatives to standardized wording, in which interviewers and web survey systems can define survey concepts as needed as a way to assure uniform comprehension across respondents. One problem is that many respondents fail to recognize that their understanding is not aligned with the survey sponsors' and so do not ask for clarification - a problem that, we argue, is more serious in the survey response task than other tasks in which information is exchanged. Using today's survey techniques (telephone and face-to-face interviews, web surveys) it is possible to increase respondents' sensitivity to their own misunderstanding, increasing their requests for clarification; and, based on respondents' verbal and visual cues of comprehension difficulty, it is possible to intervene to correct misunderstanding. This approach can be extended in surveys of the future by incorporating mature speech recognition capabilities, modeling respondent uncertainty about question meaning so that when clarification is needed it can be provided automatically, and developing interface agents when appropriate. By evaluating simulated versions of these technologies in the near term researchers will be better able exploit them as they become available.
Journal (full text)
Web survey bibliography - Schober, M. F. (14)
- Respondent mode choice in a smartphone survey ; 2017; Conrad, F. G., Schober, M. F., Antoun, C., Yan, H. Y., Hupp, A., Johnston, M., Ehlen, P., Vickers, L...
- Comparisons of Online Recruitment Strategies for Convenience Samples: Craigslist, Google AdWords, Facebook...; 2016; Antoun, C., Zhang, C., Conrad, F. G., Schober, M. F.
- Comprehension and engagement in survey interviews with virtual agents; 2016; Conrad, F. G.; Schober, M. F.; Jans, M.; Orlowski, R. A.; Nielsen, D.; Levenstein, R. M.
- Social Media Analyses for Social Measurement; 2016; Schober, M. F.; Pasek, J.; Guggenheim, L.; Lampe, C.; Conrad, F. G.
- Mobile Technologies for Conducting, Augmenting and Potentially Replacing Surveys: Report of the AAPOR...; 2014; Link, M. W., Murphy, J., Schober, M. F., Buskirk, T. D., Childs, J. H., Tesfaye, C.
- Effects of Self-Awareness on Disclosure During Skype Survey Interviews; 2013; Feuer, S., Schober, M. F.
- Disfluencies and Gaze Aversion in Unreliable Responses to Survey Questions; 2012; Schober, M. F., Conrad, F. G., Dijkstra, W., Ongena, Y. P.
- Race-of-Virtual-Interviewer Effects; 2011; Conrad, F. G., Schober, M. F., Nielsen, D.
- Which Web Survey Respondents Are Most Likely to Click for Clarification?; 2011; Coiner, T., Schober, M. F., Conrad, F. G.
- Envisioning the Survey Interview of the Future ; 2009; Conrad, F. G., Schober, M. F.
- Social Cues Can Affect Answers to Threatening Questions in Virtual Interviews; 2008; Lind, L. H., Schober, M. F., Conrad, F. G.
- Virtual Interviews on Mundane, Non-Sensitive Topics: Dialog Capability Affects Response Accuracy More...; 2008; Conrad, F. G., Schober, M. F., Jans, M., Orlowski, R. A., Nielsen, D.
- Surveys interviews and new communication technologies; 2007; Schober, M. F., Conrad, F. G.
- Promoting Uniform Question Understanding in Today's and Tomorrow's Surveys; 2005; Conrad, F. G., Schober, M. F.